Soft-In Soft-Out DFE and Bi-directional DFE 



Seongwook Jeong, Student Member, IEEE and Jaekyun Moon^, Fellow, IEEE 
Dept. of Electrical and Computer Engineering 
University of Minnesota 
Minneapolis, Minnesota 55455, U.S.A. 
Email: jeong030@umn.edu 
t Dept. of Electrical Engineering 
Korea Advanced Institute of Science and Technology 
Daejeon, 305-701, Republic of Korea 
Email: jmoon@kaist.edu 



Abstract 

We design a soft-in soft-out (SISO) decision feedback equalizer (DFE) that performs better than 
its linear counterpart in turbo equalizer (TE) setting. Unlike previously developed SISO-DFEs, the 
present DFE scheme relies on extrinsic information formulation that directly takes into account the 
error propagation effect. With this new approach, both error rate simulation and the extrinsic information 
transfer (EXIT) chart analysis indicate that the proposed SISO-DFE is superior to the well-known SISO 
linear equalizer (LE). This result is in contrast with the general understanding today that the error 
propagation effect of the DFE degrades the overall TE performance below that of the TE based on a 
LE. We also describe a new extrinsic information combining strategy involving the outputs of two DFEs 
running in opposite directions, that explores error correlation between the two sets of DFE outputs. Wlien 
this method is combined with the new DFE extrinsic information formulation, the resulting "bidirectional" 
turbo-DFE achieves excellent performance-complexity tradeoffs compared to the TE based on the BCJR 
algorithm or on the LE. Unlike turbo LE or turbo DFE, the turbo BiDFE's performance does not degrade 
significantly as the feedforward and feedback filter taps are constrained to be time-invariant. 
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I. Introduction 

Intersymbol interference (ISI) arises as the transmitted symbols overlaps with one another in high 
speed digital communication. Powerful modern equalization methods are based on the turbo equalization 
principle established in [1], wherein a soft-in soft-out (SISO) equalizer (or detector) and a SISO error- 
correction decoder exchange soft information in an iterative fashion until reliable decisions are generated. 
It has been shown in 1 1 ] that even for some heavy ISI channels the detrimental effect of ISI disappears 
with this approach. 

The detector or the equalizer portion of a turbo equalizer (TE) system often investigated is based on 
the well-known Bahl-Cocke-Jelinek-Raviv (BCJR) algorithm |2|. This algorithm exactly computes the 
a posteriori probability (APP) of the transmitted signal symbols considering the channel response and 
the a priori information of the transmitted symbols and, as such, can be viewed as an optimum SISO 
equalizer However, the computational complexity of this algorithm grows exponentially as a function of 
the channel length and the symbol alphabet set size. 

The high computational complexity of the BCJR-based equalizer has motivated considerable research 
on numerous suboptimal but low complexity equalization schemes. A notable development along this 
direction is the well-known SISO linear equalizer (LE) of [3|. Another possibility, which was also 
evaluated in 131, is the SISO decision feedback equalizer (DEE). In the classical, non-turbo setting (i.e., 
no iterative exchange of soft information between the equalizer and the decoder), it has long been known 
that the DEE almost always outperforms the LE, despite the fact that the DEE typically suffers from 
error propagation. This is because when ISI is severe with the channel response showing nulls or deep 
valleys within the Nyquist band, the LE is subject to large noise enhancement. The work of [3|, however, 
shows that when hard decisions are fed through the feedback filter (to reduce complexity), SISO-DFE 
performs considerably worse than SISO-LE, presumably due to error propagation. 

In classical DEE setting, many techniques have been investigated to mitigate error propagation |@], ||5], 
||6ll . Recently, it has been shown Q, lU, Q that conducting both normal and time -re versed equalization 
of the received data sequence with two DEEs running in opposite directions and combining two DEE 
outputs is very effective in reducing error propagation and improving bit error rate (BER) performance. 
This "bi-directional" DEE (called BiDEE) algorithm takes advantage of the different decision error and 
noise distributions at the outputs of the forward and time-reversed DEEs ||7l, HI. 

The contribution of this paper is two-fold. One is that this paper readdresses the DEE design issue in 
the turbo equalizer environment and shows that just as in classical non-turbo setting, the DEE outperforms 
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the LE, if extrinsic information is reformulated in a way that combats error propagation more effectively. 
The second contribution is a specific DFE extrinsic information combining strategy applied to a BiDFE 
that suppresses statistical correlation between the outputs of two opposite direction DFEs. We show that 
the resulting turbo BiDFE performance approaches the performance of the BCJR-based turbo equalizer 
in a fairly severe ISI environment, easily outperforming the turbo equalizer based on the SISO-LE of L3J. 
Remarkably, the performance of a time-invariant version of the BiDFE, a lower-complexity method that 
does not require tap-weight updating as a function of time, also consistently is better than the SISO-LE 
scheme of |3 | based on a time-varying linear filter. There also exist feedback equalization techniques 
that utiUze soft decisions to reduce error propagation 10, S, lITOl . ifTTI but we focus on hard-decision 
feedback in this paper, as the feedback finite-impulse-response filter complexity is greatly reduced when 
feedback decisions are constrained to take hard values. 

The remainder of the paper is organized as follows. In Section |II1 a brief statement of the problem 
is given. In Section |llll we give a quick review of the SISO equalizer design method established in 
|[3l and then provide a new formulation of the extrinsic information of DFE taking into account the 
error propagation effect. We also provide the mean-squared -error analysis of the infinite-length BiDFE 
in Section |IVl The iterative BiDFE algorithm is introduced with the extrinsic information combiner of 
the normal forward and time -reversed DFE outputs in Section |Vl In Section |Vll numerical results and 
analysis are given. Finally, we draw conclusions in Section IVIII 



We assume that the receiver knows the discrete-time baseband channel response accurately. While the 
methods discussed are general, our presentation will be based on binary symbols with = E(2;^) = 1, 
Xn G as well as real-valued ISI channel coefficients and noise samples. Although x„ typically 

represents a coded bit sequence, our analysis will assume that it is equiprobable and independent and 
identically distributed (i.i.d.). Given the transmitted bit sequence {x^}, the channel output at time n is 



where Wn is additive white Gaussian noise (AWGN) with variance A'^o and {/ifc} is the channel impulse 
response with length L^. 

In turbo equalization, the equalizer computes the a posteriori log-likelihood ratio (LLR) of Xn, 



II. System Model 



hkXn-k + W, 
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L(x„) = In 



Pr(a;- 
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Pr(x- 



-1 I rn) 
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where r„ is the received sample block utilized for LLR estimation for x„. Note that this computation 
requires the knowledge of the a priori probabilities of all input bits affecting r„. Since these a priori 
probabilities are not available, they are all set to 1/2 initially and then, as the turbo iteration ensues, to 
the estimated probability values based on the extrinsic information generated and passed back by the 
outer decoder. 

The equalizer then generates its own extrinsic information by subtracting the effect of the probability 
estimate passed down for the current bit. Write this estimated a priori LLR passed down from the decoder 

as 



La{Xn) = In 



^ Vx{Xn = +1) 



Pr(x„ = -1) 

with an understanding that the probabilities in the expression are in reality just estimates. 

Then, the equalizer's extrinsic LLR for x„ to be passed to the error-correction code decoder is given 

by 

Le{Xn) = L{Xn) — La{Xn). 

This equation suggests first computing L{xn) based on the a priori probabilities of all input bits including 
Xn and then simply subtracting La{xn) to generate the extrinsic LLR L(.{xn)- An alternative way of 
generating Le{xn) is to set La{xn) = while computing L{xn), i.e., suppress the effect of La{xn) in 
the calculation of L{xn): 

Le{Xn) = L{Xn)\L4x„)=(}- 

The techniques discussed in this paper actually use the second method. 

in. Derivation of Modified Iterative DFE Algorithm 

In this section we first briefly review the results of [Tl related to the SISO-DFE to provide necessary 
background while establishing notation. We then show a new way of computing extrinsic information so 
as to suppress error propagation and improve performance. 

A. Review of Existing Extrinsic LLR Mapping 

The work of Q has established an effective strategy of utilizing the a priori information estimates 
from the outer decoder in calculating the equalizer tap coefficients. The gist of the approach in [3| 
is a clever tweaking of the classical minimum-mean-squared-error (MMSE) estimation principle where 
the "mean" of the input symbols are constructed using the available a priori information estimates and 
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Utilized in the linear estimator weight computation. Both the LE and the DFE can be designed in this 
way, but we shall focus on the DFE here. Based on the above principle and suppressing the effect of the 
a priori probability estimate on the current bit x„ (i.e., E(x„) = 0) in an effort to extract the extrinsic 
information, the MMSE feedforward filter taps (a total of Lc + 1) and the feedback filter taps (a total of 
Ld = Lfi — 1) at time n are derived respectively as: 



= {HS„H^ + (1 - zn)ss^ + Noiy^ s 

dn = [d{n-L4, d^n-L^+l} , • • • , ^{n -1}] ^ 

= MH^c„ 



(2) 



(3) 



where H is a channel convolution matrix defined as 

hL,,~i hL,,-2 ■■■ ho 



H 



/lL,-l /^L,- 



2 • • • 





ho 



• • • hi^-i /iL,.-2 ■■■ho 
and the matrix Xl„ depends on E(j;j), i = n,n + I, ...,n + L^, computed from the decoder output as 
E{xi) = tanh{La{x,i)/2). Specifically, I]„ = Diag(OixLd, -Zn, -^n+i, • • ■ , Zu+lJ with Zi = 1 - [E(xi)]2. 
Adding the term (1 — z„)ss^ in Q has the same effect of suppressing E(a;„) to zero in H5]„H^. The 
remaining vector and matrix are defined as s = H[OixLrf, 1, OixlJ^ and M = [Il^xL^, Ol^x(l,+i)]- 
The equalizer output is obtained as 



Vn = c„ • (r^ 



Hx„ + E(x„)s) 



(4) 



where the received vector is defined as = [r„, r„_|_i, . . . , r„+Lj and the composite vector of the causal 
symbol decisions and the anticausal symbols' mean as x„ = [xn-La^ ■ ■ ■ > E(x„), . . . ,E(x„+lJ]^ 
where Xi is the available decision for Xi based on the a posteriori LLR of Xj, i.e., if L{xi) = La{xi) + 
Le{xi) > 0, then, Xi = +1; otherwise, Xi = —1. The addition of the E{xn)s term is also to suppress the 
effect of E(x„) in Hx„. 

Define the anticausal symbol sequence x„ = Xn+i, . . . , Xn+i^]^ , the causal symbol sequence x^ = 
[x„_L,,x„_L^+i, . . .,Xn-if, and the available decision sequence x^ = [x„_l^, Xrt-L,+i, • • . 
Also define the noise sequence as Wn = [wn,Wn+i, ■ ■ ■ ,u)„+lJ^. Then, the combined filter output y„ 
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can be rewritten as 

Vn = (c^Hi) • (x„ - E{x„}) + d^(x^ - x^) + c^w„ 

Ld Lc La 

C{n,k}'>^n+k 

k=l k=l k=0 

= P{nfi}Xn + in + Vn (5) 

where E{x„} = [0, E(a;„+i), E(a;„+2), • • • ,^{xn+Lc)]^ and Hi is the (Lc + 1) x {Lc + 1) submatrix 
of H formed by the entire rows of the columns from the (L^ + l)th to the last. Moreover, p„ = 

[P{nfl}^P{n,i}: ■ ■ ■ ^P{n,La}\ = ^raHi and P{nfi} = c^s. The error propagation caused by the mismatched 
hard decision feedback is denoted as in, i.e., i„ = X]fc=i d{n-k} [xn-k — Xn-k) and f „ is the sum of noise 
and the remaining ISI terms caused by the neighboring symbols: Vn — Ylk=i P{n,k}{xn+k — ^{xn+k)) + 
Eik=o C{n,k}Wn+k- The variance of Vn is 

Var(i;„) = c^Cov{r„r^ | Xn = xjc^ 

= c^s(l - s^c„). (6) 

Assuming that the feedback decisions are all correct, i.e., in = 0, and Vn is AWGN, the extrinsic LLR 
is naturally given by 

Pr{xn = +1 I y„ 



Le{Xn) = 'i.n 



PliXn = -l\y: 

In 



Pr(y„ I Xn = +l)Pr(x„ = +1) 



= ln 



Pr(y„ I Xn = -l)Pr(a;n = -1) 

Pr(j/n I Xn = +1) 

Pr(j/n I x„ = -1) 
\yn-P{n,0}\ _^ \yn+P{n,0}\ 



ia(a;„)=0 



2Var(u„) 2Var(t;„ 

2P{n,0}yn 



(7) 



Var(i;„) ' 

Notice that in generating La{xn) was already suppressed to zero. 

A glossary of frequently used symbols is given below. Time-varying quantities are augmented with 
time index n as the subscript. 

B. New Formulation of Extrinsic Information 

While the MAP estimation of in is equal to zero, we observe that the chance of i„ / is relatively 
high for severe ISI channels. Our strategy is to estimate in and utilize the statistical parameters associated 
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DFE feedforward filter coefficients of lengtli Lc + 1 


Xn 


transmitted symbol 


J 

dn 


UJ^B leeabacK niter coemcients oi length 


Wn 


channel noise 


TT 

rl 


channel convolution matrix 


T} 


average power of Xn 


IVl 


FT n 1 


AT 


variance of w„ 


S 


TTFr* 1 r\ "[T 

H[Oixi,d, 1,0ix_lJ 


{hk} 


ISl channel response or length Lh 


Pn 


c^Hi wliere Hi is a submatrix of H 


r„ 


received chaiuiel output 


Tn 


received sample vector 


Vn 


equalized observation 




vector of causal decisions and anticausal's mean 


In 


error due to mismatched past decisions 


Wn 


noise sample vector 


Vn 


noise plus error due to pre-cursor ISI 




transmitted anticausal symbol vector 


P{n,0} 


weight on Xn in j/n 


c 


transmitted causal symbol vector 




a priori LLR of Xn 




estimated causal symbol vector 


T f ^ \ 


a posteriori LLR of Xn 




equalized causal sample vector 


Le. {Xn) 


extrinsic LLR of Xn 




possible causal error sequence 




variance of Xn 




covariance matrix of transmitted anticausal symbols 




variance of Xn estimated via a posteriori LLR 




coviiriancc malrix of csliinalcd causal symbols 


Pn 


noise correlation coel'licienl bcUvcen two Dl-lis 



with this estimate in the formulation of the extrinsic information. Since in is to be estimated on the basis 
of the observation yj^ = [yn^L^^yn-Li+i-, ■ ■ ■ , Vn-i]'^^ the mean and variance of in can be evaluated by 
the a posteriori probabilities of the causal symbols. Write 

E{in)^E{dl{^^n-K)\y'n} 

= C(tanh(L(x^)/2)-x^) (8) 
Var(i„)^Var{d^(x^-x;^)|y^} 

= dl±'ndn (9) 

where L(xfJ = [L(a;„_iJ, . . . , = Diag i„_z,^+i, . . . , 4_i), and 

Zn = l- tanh(L(a;„)/2)2. 

Now, let us consider the possible causal error sequence ^"^nj} ~ '^{n j}~^n for j = 1,2,..., 2^^*, with 
index j pointing to a particular binary pattem of x.^. Then, we can compute the extrinsic information for 
the given causal error sequence ^^nj}- 

(x„ e? . I ) = In — ■ — i — 

^ 2p{n,o}(j/n-d^e^„ .p ^^^^ 
Ys3:{vn) 
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To compute the extrinsic infomiation of Xn taking into account the probabiUties of possible error 
sequences, we write 

PiiVn I Xn = +1) = J]]Pr(y„ I Xn = +1, e|„^^.|)Pr(e|„^^.|) 



j=i 1 + exp (^Le(x„|e^^_^.j)^ 



Pr(y„ I x„ = -l) = ^Fr{yn \ x„ = -1, e|„^^.|)Pr(e|„^^.|) 

=E — v- (12) 

j=i 1 + exp (^Le(x„|e|^ 
Accordingly, the extrinsic information of Xn considering the distribution of i„ is given as 

2 



Le(x„) = In O ^ J r > - In O . ^ > • (13) 

^^=1 l + exp(^Le(2;„|e^^^^.pj J [ ^=1 1 + exp (^Le(x„|e^^^^.p j J 

In principle, the extrinsic information of ([T3T l can be evaluated using (ITOl) and approximating Pr(e|^^.|) 
or Pr(e|^ ^.||y^) by Y[k=i^^(^{n-k,j}\yn~k), which can be computed based on the a posteriori LLRs 
of x^. 

However, since the computational complexity of (fT3l) increases exponentially according to the length 
of feedback filter, Ld, we seek a more practical modification. A possible solution is to apply the Bayes' 
rule only for the two mutually exclusive cases of i„ = and in / 0. Then, 

Pj.(-y I 3. _ j^i^ _ exp {Le{xn\in = 0)) Pr(^n = 0) _^ exp {Le{Xn\in / 0)) Prfa / 0) ^^^^ 

1 + exp {Le{xn\in = 0)) 1 + exp (Lg (x„ |i„ / 0)) 

p. I ^^ Pr(^n = 0) , Pr(in / 0) 
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The extrinsic information of x„ for each case of in can be estimated as 



LeiXn\in — 0) ■ 



Var(t;„) 



(16) 



LeiXn\in / 0) = 111 



exp(Le(x„|e^„ .p)Pr(eJ„ 



In 



j=i,e^„ ^j^o |l + exp (^Le(x„|e^^_^.p^ I Pr(i„ / 0) 



E 



j=i,e^^ ^j^o {l + exp (^Le(2;„|e^„^^.-^)) | Pr(i„ / 0) 



: In 



In 



2^<i / 

E 



1 Le{Xn\e' 

2 + 4 



Pr(e|„_^ 



J Pr(i„ / 0) 

1 ^eixn\el^j}) \ Pr(e^„ 

2 4 j Pr(i„ / 0) 



(17) 



I / 1 2p{n,o} (?/n - in) 

h„ I 2 ^ 4Var(7;„) 



In < E 



1 _ 2p{„,0} iVn - in) 

2 ~ 



,^(^^Pin,oyiyn-Ei^n\^^^0))^_^J^ 
[ Var(u„) J [ 



4Var(7;„) 
P{n,o} iVn - E(i„|«„ / 0)) I 



Var(z;„) 



7 



2v9„/(l - V9„) if < 
2ipn/{l + v^n) Otherwise 

29?n 



(18) 



(19) 



1 + \<fn\ 

where ipn = P{n,o} iVn - E{in\in / 0))/Var(u„), E(z„|i„ / 0) = E(i„)/Pr(i„ / 0), Pr(z„ = 0) = 
nfc=iexp(|L(x„_fc)|)/(l + exp(|L(x„_fc)|)), and Pr(i„ / 0) = 1 - Pr(i„ = 0). The approximation 
of ([TT] ) is from the first order Taylor expansion at zero, i.e, e^/(l + e^) ~ 0.5 + 0.25x and 1/(1 + 
e^) ~ 0.5 — 0.25x. Furthermore, we also use ln{l + (pn} — ln{l — (pn} = ln{l + 2(^„/(l — Pn)} = 
— In {1 — 2(pn/ (1 + ^n)} and ln(l + x) ~ x in ([TSl l. In other words. In {1 + 293„/ (1 — ~ 299„/ (1 — 
(fn) is used for < while — ln{l — 2(/?„/(l + — 2(y9„/(l + ipn) is used for > 0. 
Finally, the extrinsic information of x„ is given as 



LeiXn) = ln 



exp {Leixn\in = 0)) Pr(i„ = 0) _^ exp (Le(Xn|in ^ 0)) Pr(in 7^ 0) \ 

1 + exp (Le(2;n|in / 0)) J 



In 



1 + exp (Le(x„|i„ = 0)) 
Pr(in = 0) 



+ 



Pr(in / 0) 



(20) 



1 + exp {Le{xn\in = 0)) 1 + exp (Le(x„|i„ / 0)) 
While this gets passed to the outer decoder as equalizer's extrinsic information, hard decisions that 

propagate down the feedback filter are generated by slicing Le{xn) + La{xn) where La(x„) is the 

extrinsic information from the decoder 
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C. Time-Invariant Filters 

As also discussed in |3], the filter tap values derived above are time- varying and creates significant 
implementation challenges. A low-complexity variation would be to simply assume the classical (non- 
turbo) DFE forward and feedback filter tap solutions as in 

c = [co,c+i,...,clJ^ 
= (HSH^ + iVol)"^s (21) 



d = [(i_L,,d_L,+i,...,(i_ 



ij 



= MH^c, (22) 

where S = Diag(OixLd> lix(Lc+i))' effect of decoder feedback come into play through the 

subtraction of Hx„ — E(x„)s from the channel observation vector (see (@)) and the enhanced a posteriori 
LLR computation: Le{xn) + La{xn) where La{xn) represents the decoder feedback. 
By an obvious modification of the equalized signal is obtained as 

Vn = PoXn + in + Vn (23) 
where po = C^S, i„ = Y.k=l'^-k{xn-k -Xn~k), Vn = Y.k=lPk{Xn+k - E{Xn+k)) + Y.k=0^kWn+k, 

and p = [po,Pi, ■ ■ ■ ,Pl,] = c^Hi. The mean and variance of i„ and the noise variance of Vn with the 
time-invaiiant filters are also given by 

E(i„) = (tanh(L(x^)/2) - x^) (24) 
Var(i„) = d^S^d (25) 
Var(w„) = (HSnH^ - z„ss^ + NqI) c. (26) 

IV. SNR Advantage of BiDFE 

The idea of BiDFE is already motivated in Q, IH by the fact that DFE can be performed on the 
reversed received sequence using the time -reversed channel response. Here we derive the SNR figure- 
of-merit for BiDFE assuming ideal feedback in both ways and allowing infinitely long filter lengths. We 
then compare the result with those of the usual, single-sided DFE as well as the matched filter detector 
(i.e., ideal detector under zero-ISI condition). As will be seen, the ideal BiDFE SNR is significantly better 
than the ideal DFE SNR especially at high channel SNRs, further motivating a turbo BiDFE scheme. 
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A. Unbiased MMSE-DFE 

It is well known that the D-transforms of the feedforward and feedback MMSE-DFE filter coefficients 
are, respectively lITll : 

"^^^ = Po9^{D-*y ^^^^ = 9(D) (27) 
where Pq is such that logPo = ^ /^^ log i?ss(e^^^)d0 and g*{D^*) is obtained from spectral factoriza- 
tion: Rss{D) = PAh{D) + No = Pog{D)g*{D-*) where Rhh{D) = h{D)h*{D-*) and h{D) is the 
D -transform of the channel impulse response. 

The unbiased equalized outputs of the normal MMSE-DFE in the forward direction, Yf{D), are given 

by 



MSEuDFE={ r. \r ^{WfJ') = „ " (30) 



Yf{D) = x{D) + -^^e){D) (28) 

where 

^ Po V g*{D'*)J ' Po9*{D-*) 
with w'{D) denoting a complex- valued Gaussian noise sequence with autocorrelation function R^'w' {D) = 
NoRhhiD)- Then, the mean-squared-error (MSE) and SNR of the unbiased normal MMSE-DFE are given 
by 

B. Unbiased Time-Reversed MMSE-DFE 

Now, let us assume that the transmitted data sequence Xn is of a finite length so that the MMSE-DFE can 
be performed on the time-reversed received signals using the time -reverse of the original channel impulse 
response |[T3l . Denoting the time-reversed ISI channel coefficients as hn = its D-transform is 

given as h{D) = D^''^^h*{D^*). Therefore, the D-transform of the autocorrelation function of the 
time -reversed channel is given by Rj^j^{D) = h{D)h* {D^*) = Rhh{D)- Accordingly, the feedforward 
and feedback filters of the time-reversed MMSE-DFE, denoted by c{D) and d{D) — 1 respectively, are 
identical to the normal MMSE-DFE filters, i.e., 

c{D)=c{D) = ^--^-^^, d{D) = d{D)=g{D). (32) 
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The unbiased output of the time -reversed MMSE-DFE can be expressed similarly to the case of the 
normal, forward MMSE-DFE except that the unbiased output sequence right after the time-reversed 
MMSE-DFE should also be time-reversed, in order to get the unbiased equalized output Ife(-D) matched 
to the input sequence x{D). Therefore, 

Y,{D) = x{D) + _^e',p) (33) 



+ (34) 



where 



Po V 9{D)J ' ' Po \g{D) 
Then, the MSE and SNR of the unbiased time -reversed MMSE-DFE are given by 

C. Unbiased BiDFE 

The structure of the BiDFE is shown in Fig. [T] If we assume that the feedback sequence is correct, 
the outputs of two unbiased DFEs are: 

Yf^n = Xn + V},n (37) 
n,n = ^n + Vfe,„ (38) 

where Vf^n and Vb,„ have D-transforms Vf[D) and Vh{D) as given by (from dH]), (l29), (l33]l, and (|34] |) 

Assuming stationary random processes, we drop time index n for notational simplicity and write: 
Yf = X + Vf and Y^ = X + Vi,. From (|30] | and (l35T l. the variance of Vf and V5 are also given as: 

PxNo 



Var(y^) = Var(Vb) 



Po-No' 
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The variables Vf and Vb are correlated with the correlation coefficient given by 

E{VfVC) 



A 

P = 



E[Vf{D)Vb*{D- 



2 



X 



No{Po - No) 

p2 
M) 



-E 



g*{D- 



w'{D)w'*{D-*) 



(41) 



{c{D)Y R^,^,{D) 



P,No{Po - No) 

{c{D)fRhh{D) 



p2 



(42) 



P^{Po-No) 

where [z(D)]q = zo with z{D) = z^D^. The equality in (|4TI ) holds due to the assumption that Xn is 
an i.i.d random variable and the self-interference term is removed from the expression 1 — 1/ g* {D^*). 

Since Var(V/) = \w{Vi,), the linear MMSE combiner of Q, IH becomes Y = \{Yf + Y^). 
Naturally, the MSE and SNR of the unbiased BiDFE are given as 

(1 + Re[pl) (1 + Re[pl)P^.iVo 

SNRf/BiDFE - ^^ot:. = -JT—^-TT^^^^UDFE = ^, p r i °1 (44) 

MSEuBiDFE (1 + Re[pj) [l + Re[p\)No 

where Re[p] denotes the real part of p. 

Note that the infinite-length normal/time -reversed MMSE-DFE and BiDFE analyzed here do not exploit 

the a priori information of Xn- In other words, the feedforward and feedback filters of DEE are derived 

by assuming E(X„) = for all n, meaning that the calculated SNR performance would reflect the 

non-turbo ideal-decision BiDEE performance with time-invariant filter taps of Section IIII-CI 

V. Derivation of Iterative BiDEE Algorithm 

We now discuss an iterative BiDEE algorithm. Iterative equalization schemes based on BiDFE are 
shown in Fig. |2] Basically, the channel equalizer is a SISO equalizer which employs the normal forward 
DEE, the time-reversed DEE and an LLR combining block. The received data sequence is equalized in both 
directions by the two DEEs, and the extrinsic information from two DEEs are combined and passed to the 
error correction code decoder. We show that a proper combining of the two sets of extrinsic information 
can suppress error propagation and noise further and generate more reliable extrinsic information for the 
outer decoder. 
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A. Combining Extrinsic Information 

Similarly to the finite-length time-varying feedforward and feedback filter of the normal DFE at time 
index n, which are previously defined as c„ in Q and d„ in we also define the finite-length time- 
varying feedforward and feedback filter of the time-reversed DFE at time index n as c„ and d„ with the 
same lengths as c„ and d„ respectively. Note that c„ and d„ are defined in a similar way as dU and (jS) 
except that the channel convolution matrix H for the time-reversed channel is given as 

ho hi ■ ■ ■ hi,^-! ••• 

- ^ hohi ■■■ hL.^i • • • 
H = 

_0 ••• ho hi---hL,-i_ 
The unbiased equalizer output |[T2l corresponding to the transmitted coded symbol from the the normal 
(forward) and the time-reversed (backward) DFE can be represented respectively as 

y/,„ = Xn + //,„ + V/,„ (45) 

n,n = Xn + h,n + 14,n (46) 

where X„ = x„, V/.„ = ^;/,„/p{„,,o} and = i/,„/p{„,o}- Also, Vb^n = ^^6,n/P{n,o} and 4.„ = 
ib,n/P{n,o} where Vb,n and if, „ are defined similarly to the normal DFE and P{n,o} = c^s where s = 
H[OixLd, li OixLe]^- For notational simplicity, we further drop time index n with an understanding that 
processing remains identical as n progresses: Yj = X + If + Vf and Yf, = X + + Vh- 

Now, we discuss the problem of how to combine the extrinsic information from two DFEs. Initially, 
let us consider two unbiased equalizer outputs, which are corrupted by AWGN, corresponding to the 
transmitted coded symbol X: 

Yf = X + Uf 
n = X + C/b 

where the noise U f and Uh are assumed to be zero mean Gaussian random variables which are independent 
of the coded data X but correlated with each other with correlation coefficient p. 

In order to combine the extrinsic information, it is beneficial to whiten the noise Uf and C/f, before 
combining. The noise correlation matrix R is defined as 

Nf p^NjW, 



Y^r{Uf)E{UfU,) 



EiUfUb) Var(C/b) 
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where Nf = YaT{Uf) and A'^;, = Var([/f,). Then, the eigenvalues of the noise correlation matrix, Ai and 
A2, with their corresponding normaUzed eigenvectors gi and g2 are given by 



Ai 
A2 



{Nf + Nb) - ^{Nf - iVb)2 + Ap^fNb 



Vail + g'ii 



gn 

921 



g2 



512 
522 



where gn 
and 521 
unless p 



{Nf-Nb)+yJ{Nf - NbY + Ap'NfNb 



, 912 



{Nf-Nb)- ^{Nf - Nbf + ^p'NfNb 



922 = P\/^fNb- It is easy to see that the noise correlation matrix R is non-singular 
±1. If R is non-singular, R can be expanded as R = GAG~^ where G = [gi g2] and 
A = Diag(Ai, A2). Since G is a unitary matrix, the noise whitening matrix is A = [ai a2] = G^^ = G^ 
where ai = [an a2i]^ and a2 = [ai2 a22]^- So, given the equalized output vector Y = [Yf,Yh]'^, the 
whitened vector is Y' = [YpY^]'^ = AY with the new noise correlation matrix R' = ARA^ = A. 
Finally, the extrinsic information of X can be expressed as 

Pi{Yf,Yb\X = +l) 



In 



Fi{Yf,Yb\X = -1) 
Fi{Y},Y^\X = +l) 
Pj:{Y},Y;\X = -1) 

Pr(y; I X = +1) 



■■ In , — + In ■ ' ^ 



Fi{Yj I X = -1) 



Pr(K' I X = -1) 



2(011+012)^/ ^ 2(021 + 022)1;^ 

Ai A2 
2{Nh-p,/Njl%)Yf 2{Nf- p./NjNl)Yb 



(1 - /52) NfNb 



+ 



(1 - /52) NfNb 



im-py^) {Nf-p^mjK) 

-Lej(X) H -^r— Le,b[X). 



(47) 



{l-p^)Nb ^'^^ ^ {l-p^)Nf 
For the singular noise correlation matrix R (i.e., p = +1), Nf = N^ = N and Yf = Y^ = Y so 
that Lf.j{X) = Le 5(X). Consequently, the extrinsic information of X becomes L^iX) = 2Y/N = 
{Lej{X) + Le,b{X))/2. Note that the mean combiner of [9|, Le{X) = {Lej{X) + Le,b(X))/2, can be 
considered as the proposed combiner with p = +1. If p = —1, Uf = —Ub and we can cancel out the 
noise perfectly by averaging the outputs: (Yf + Yb)/2. The extrinsic information of X in this case is 
Le(X) = +00 when {Yf + Yb)/2 > while Le{X) = -00 when {Yf + Yb)/2 < 0. 



January 19, 2013 



DRAFT 



TO APPEAR IN IEEE TRANSACTIONS ON COMMUNICATIONS 



15 



B. Reducing the Combiner Sensitivity to the Estimation Error 

Let us consider the effect of errors in estimating p on extrinsic information. Write p = p + e where e is 
the estimation error. Then, the sensitivity of the combiner in WT\ to the estimation error can be defined 
as 

dLe{X) 



S(P) 



dp 

(2piV,-(l + p^)7]V^) ^ {2pNf-{l + p^).jNjNl) ^ 



which approaches infinity as p — )• ±1. This means that the combiner of (|47] ) is unfortunately very sensitive 
to the correlation estimator error, as the magnitude of the correlation becomes large. 

The sensitivity of the combiner can be reduced if we assume that the variance of Uj and Ui, are the 
same, i.e., N = Nj = = {Nj + Ni,)/2. This assumption is reasonable when the same feedforward 
and feedback filter length is used in both DFEs. Then, from (|47] ). the combined extrinsic information of 
X for non-singular R is simply given as 

1 



Le{X) 



LejiX) + Le,biX) 



(48) 



with the sensitivity to the correlation estimation error 

1 



S(P) 



L,j{X) + L,^,{X) 



{i+py 

Although the sensitivity of this combiner to the estimation error also goes to infinity as p 
more robustness as p — ^ +1 since liiUp^+i S(p) = |(Lej(X) + Le,b(X))/4|. 



-1, it shows 



C. Application to the BiDFE Algorithm 

In this paper, although the composite noise /j „ + V/ „ and „ + Vb^n are not Gaussian, we exploit the 
combiner of (l48T l in order to produce the combined extrinsic information to be passed to the convolutional 
decoder. The noise correlation coefficient between „ + V/ „ and /{, „ + Vb^n is naturally defined as 

E {(//,„ - E(//,„) + Vf,n) {Ib,n - E{Ib,n) + 



Pn '■ 



(49) 



V(Var(/j,„) + Var(y^,„)) (Var(/6,„) + VaT{Vb,n)) 
Unfortunately, it is difficult to compute the correlation coefficient analytically in the presence of decision 
feedback errors. However, assuming that the noise is stationary, we have Pn = P and the correlation 
coefficient can be estimated through time-averaging: 

Z - X^,„ - E(/^,„))(n,n - X,^n - E(4,„))| 

^ (50) 



E(y/,„ - Xf^n - E(//,„)) VE(^M - Xb,n - E(v)) 
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where the summations are over some reasonably large finite window. Note that the hard decisions for the 
transmitted symbols in normal and time-reversed DFEs might be different; in estimating the correlation 
coefficient, we only consider those noise samples for which ^/,n and „ are identical. 

Let us summarize our LLR combining method: 1) The extrinsic information Lej(X„) and Le,b(X„) 
for n = 1, 2, . . . , L are acquired according to (|20] i in the normal and time -reversed MMSE-DFE settings. 
2) Estimate the noise correlation coefficient, p, between /j „ + Vy „ and „ + Vh^n by (l50l ). 3) Generate 
the combined extrinsic information Le(X„) according to (l48T l with pn = p- 



D. Correlation Analysis under Ideal Feedback 

We provide correlation analysis in the following. The analysis will allow validation of (l50l ) in different 
scenarios. The observation of how the simulated correlation coefficient (|50l ) converges to the analytically 
computed one under the assumptions of ideal feedback and perfect a priori information will also provide 
useful insights into the iterative behaviour of the proposed turbo BiDFE. 

First of all, the noise variance of Vf^n and V;, „ from the time-varying filters are: 

Var(yj,„) = (1 - s^c„)/c^s 
Var(Vb,„) = (1 - s^c„)/cp. 

When we assume ideal decision feedback, Pr(/j = 0) = Pr(/f, = 0) = 1 so that „ = „ = 0, the 
noise correlation coefficient /?„ between Vy „ and Vb^„ becomes 

A nyf,nyb,n) 



VVar(y^,„)Var(y,,„) 
E 



1 



P{n,Q} j=0 



1 ic 



. P{n,0} k=0 



V'(l - sTc„)/c^Sv/(l - s^c„)/c^s 

I] I] C{„j}C{„_fc}E [Wn+jWn-k+Lh-l] 
j=0 k=0 

^c^s(l - S^C„)^Cp(l - S^C„) 

/ Lo \ 

E E C{nj}C{„,fc}(^(j + A; + 1 - L/i) 

j=Ofc=0 



(51) 



^c^s(l - s^c„)^cp(l - s^c„) 



V 



(52) 



where 6{t) is defined as: if t = 0, 6{t) = 1; otherwise, 8{t) = 0. The equality in (ISTI ) holds because X„ 
is an i.i.d random variable. 
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If the time-invariant filters are used instead of the time-varying filters, the variances of V/^„ and Vb^; 
become 



Var(Vfe,, 



2^ (H5]„H^ - z„ss^ + NqI) c/ (c^s)^ 



z„ss^ + iVol) c/ (c^s) 



Then, the noise correlation coefficient can be also obtained as 
/ 

Pn = No 



Yl Yl CjCk5{j + k + l- Lh) 

j=0 k=0 



^c^ (H5]„H^ - ZnSsT + NqI) ca/c^(H5]„H^ - z„ss^ + iVoI)c 



(53) 



Now, let us consider some special cases. 

1) No A Priori Information: When no a priori information is available, i.e., E(X„) = for all n, 
the feedforward and feedback filters are the same as the time- invariant filters and the noise variances are 
stationary: 

Var(V/,„) = Var(y/) = (1 - s^c)/c^s 
Var(H,„) = Var(H) = (1 - s^c)/c^s. 
Therefore, the noise correlation coefficient is given by 



Pn = P 



Nn 



E E CjCk5{j + k + l- Lh) 

j=0 k=0 



Vc^s(l-s^c)Vc^s(l-s^c) 



v 



(54) 



We observed that the noise correlation coefficient of the infinite-length BiDFE in (1421 ) is almost identical 
to that of the finite-length BiDFE in ( |54l ) when Lc is chosen to be long enough. 

2) Time-varying Filters with Perfect A Priori Information: When several iterations are performed at 
high SNRs in turbo equalization, the perfect a priori information could be available, i.e., E(X„) = X„ 
for all n. When E(X„) = Xn for all n, the feedforward filters c„ and c„ of two DFEs become the 
normalized matched filters corresponding to the forward and reverse channel impulse responses: 

c„ = A [ho, hi,..., hi^-i, OixL,-L^+i]^ 



Cn=A [/iLh-l, ■■■ ,ho, OixL,-Lft + l]^ 
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where ^ is a real-valued constant depending on SNR, i.e., A = 1/{Nq + X]fc=o^ l^fcP)- Moreover, since 
the first terms of Vj^n and Vb^n disappear, the noise variances are simply: 

AT a2 

Var(l/^,„) = Var(y^) = iVoc^c„/(c^s)2 = -A^ J] \hk\^ 

^^^^^ k=o 

Var(H.„) = Var(Fb) = iVoc^c„/(c^s)2 = ^ \hkf. 

Accordingly, the noise correlation coefficient is 

Pn= p=l. (55) 

Note that the noise correlation coefficient p with perfect a priori information converges to 1 regardless 
of the SNR value. As will be shown shortly, the measured correlation coefficient using simulated turbo 
BiDFE outputs indeed approaches 1, as turbo iteration progresses. This indicates that both assumptions 
- ideal decision feedback and perfect a priori information - are reasonable. 

3) Time-invariant Filters with Perfect A Priori Information: When the time-invariant filters are used 
with perfect a priori information, the time-invariant DFEs yield the noise variances as 

Var(y/,„) = Var(T/^) = iVoc^c/(c^s)2 

Var(yb,„) = Var(yb) = NQcFc/{(Fsf. 

The noise correlation coefficient is also simply given by 

E E CjCk6{j + k + l- Lh) 

3=0 k=0 

Pn= P= • (56) 

V c-* cv c-* c 

As will be discussed in the next section, in the simulation of turbo BiDFE with time-invariant taps it 
is observed that the BiDFE output correlation does indeed converge to (|56] |. indicating again that the 
assumptions of error-free decisions and perfect a priori information are reasonable. 

VI. Simulation Results 

In this section, simulation results of several iterative equalization schemes are presented. The trans- 
mitted symbols are encoded with a recursive rate- 1/2 convolutional code encoder with parity gener- 
ator (1 + + + D"^) with 2^^ message bits and are modulated by binary phase-shift keying 
(BPSK) so that x„ G {il}- We also assume that the noise is AWGN, and the noise variance and 
the channel information are perfectly known to the receiver. The ISI channels with impulse responses 
hi = (l/^/T9)[l 2 3 2 1]^ and ha = (l/\/44)[l 2 3 4 3 2 1]^ investigated in |3| and 
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lITOl are used for evaluating the performance of the iterative equalizers. These channels are considered 
very severe ISI channels as the channel spectra possess nulls over the Nyquist band, as shown in Fig. 
[3j Finally, the decoder is implemented using the BCJR algorithm. Only the SISO equalizer changes 
from one scheme to another. The MMSE-DFE with 17 feedforward taps and 4 feedback taps is used for 
both the normal and the time -reversed DFEs on hi while MMSE-DFE with 21 feedforward taps and 6 
feedback taps is used on h2. Finally, the linear MMSE equalizer uses 21 taps for hi and 27 taps for h2. 

Six different equalizer types are simulated in this work. The notation "TV-" denotes equalizers with 
time-varying filters while "TIV-" indicates those with time-invariant filters. For instance, "TV-LE" in 
the legend indicates the linear MMSE equalizer with a time-varying filter. The "Proposed DEE" uses 
the proposed LLR mapping of (l20l ) while "DEE" uses the conventional LLR mapping (as used in 131) 
The "Proposed BiDEE" is the iterative BiDEE algorithm which is described in Section |V] In other 
words, "Proposed BiDEE" uses the the proposed LLR generation for both normal and time-reversed 
DFEs along with the proposed extrinsic information combiner of (l48T l in conjunction with the noise 
correlation coefficient of (|50l l. The "BiDFE (mean combiner)" is the iterative BiDEE algorithm with the 
conventional LLR mapping and the mean combiner, L(,(X) = (Lg + Le,b(X))/2 (of Q), simulated 
for performance comparison purposes. Finally, "MAP" is the optimal equalizer implemented via the 
BCJR algorithm. 

A thorough comparison is given in ||3] on the required complexity levels of the SISO-LE, SISO-DFE 
and the MAP equalizers. The exact level of implementation complexity is hard to assess as it depends 
highly on specific VLSI architecture details. Roughly speaking, however, it is safe to say that the number 
of multiplications and additions increases as an exponential function of the channel memory length for 
the MAP equalizer whereas the number of the same operations is a quadratic function of both the channel 
memory length and the filter length for the TV-LE and the TV-DEE, as shown in [31 . The number of 
operations, on the other hand, increases only linearly for the TIV-LE and the TIV-DFE (3). The BiDFE 
equalizers, including the proposed BiDFE methods, require roughly twice as many operations as the 
DEE counterparts, due to the presence of the time-reversed filter components. Most notably, while the 
complexity of the proposed BiDFE with time-invariant filters is considerably lower than that of the MAP 
equalizer as well as the TV-LE, the performance is significantly better than the TV-LE. 

Fig. |4] shows the performance of several turbo equalizers with time-varying filters after 20 iterations. 
TV-DEE with the conventional LLR mapping shows poor performance but once the proposed LLR 
generations are used ("Proposed TV-DEE"), the DEE performance becomes clearly better than the TV- 
LE method of [3 |, except at very high SNRs where all schemes other than the conventional DEE perform 
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comparably. The "Proposed TV-BiDFE" is considerably better than the TV-BiDFE based on the mean 
combiner, approaching the performance of the MAP scheme. 

Fig. [5] shows the BER performance of time-invariant-filter-based turbo equalizers. As the figure indi- 
cates, the "Proposed TIV-DFE" also shows superior performance to the "TIV-DFE". The performance 
of "Proposed TIV-BiDFE" is very close to the performance of the MAP equalizer while requiring low 
computational complexity based on the use of time-invariant filters. Also notice that both "Proposed 
TIV-DFE" and "Proposed TIV-BiDFE" achieve decision-error-free performance at low BERs, indicating 
the error propagation effect has been nearly eliminated using the proposed LLR generation method. It 
is noteworthy that the proposed BiDFE algorithm still provides near-optimal performance even with the 
time-invariant filter taps. While the TIV-BiDFE based on the existing mean combiner appears to perform 
almost as well, the EXIT chart analysis to be discussed below indicate that with a smaller number of turbo 
iterations, its performance is distinctly inferior to the proposed TIV-BiDFE based on the new combining 
method. 

Figs. |6] and |7] show a similar set of simulation results now applied to the more severe ISI channel h2. 
While all DFE-based schemes lag clearly behind the BCJR-based scheme at the error rates simulated, 
the proposed BiDFE scheme in both the time-varying and time-invariant filter cases outperform the LE 
scheme by a significant margin. In fact, in this severe channel the BER curve of the LE scheme, even with 
time-varying filters, appears to diverge considerably from the ideal no-ISI curve. Overall, the proposed 
BiDFE based on time-invariant filter taps offer excellent performance-complexity trade-off. 

The noise correlation in one block of coded data bits is described in Fig. [8j at different iteration numbers 
at a 6 dB SNR on hi. The correlation coefficient of "Proposed TV-BiDFE" goes to 1 as the number of 
iterations increases because the a priori information from the decoder becomes reliable, and the time- 
varying filters in the normal and the time -reversed DFEs produce essentially the same equalized output 
sequences. This phenomenon of Fig. [8] validates (l55l) . On the other hand, the correlation coefficient of 
"Proposed TIV-BiDFE" actually decreases as the number of iterations increases, and the noise correlation 
coefficient converges to that of "TIV-BiDFE with Ideal Feedback" or the correlation coefficient of (|56) . 
This is because the decision feedback errors disappear and the perfect a priori information is available 
from decoder. Note that the filter coefficients in both DFEs do not change with the a priori information. 

In general, it is quite difficult to analyse the iterative equalization and decoding schemes. We rely on 
the oft-used extrinsic information transfer (EXIT) chart of ifTSl to develop insights into the convergence 
behaviour of the turbo equalizers. The EXIT chart is a diagram demonstrating the mutual information 
(MI) transfer characteristics of the two constituent modules which exchange soft information. In the EXIT 
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charts, the behavior of the channel equaUzer is described with its input and output on the horizontal and 
vertical axis, respectively, while the behavior of the decoder is described in opposite way. The pair of 
EXIT chart curves typically defines a path for the MI trajectory to move up during iterative processing 
of soft information. The number of stairs that a given MI trajectory takes to reach the highest value 
indicates the necessary number of iterations toward convergence. 

Figs. |9] and [TT] show the EXIT chart corresponding to time-varying-filter-based equalizers for hi at 
a 6 dB SNR and h2 at a 10 dB SNR while Figs. [H and [H] show the similar EXIT charts for time- 
invariant-filter-based schemes. Although not shown here to avoid excessive cluttering, the trajectories of 
"TV-DFE" and "TIV-DFE" move up for the first couple of iterations, but then quickly fizzle out due to 
the inadequate extrinsic LLR generations that cannot handle error propagation. However, the trajectories 
of "Proposed TV-DFE" and "Proposed TIV-DFE" keep moving up as the number of iterations increases, 
clearly indicating the advantage and effectiveness of the proposed LLR generation method. However, 
the trajectory of "Proposed TIV-DFE" at 6 dB or 10 dB does not reach the maximum possible value 
since the filters do not fully exploit the a priori information from the decoder The trajectories of the 
"Proposed TV-BiDFE" and "Proposed TIV-BiDFE" indicate that these schemes move from bit of mutual 
information to 1 bit with a less number of iteration runs than "Proposed TV-DFE", "Proposed TIV-DFE", 
"TV-LE", or "TIV-LE". 

We notice, however, that the proposed BiDFE scheme requires more iterations in achieving the fuU 
performance, relative to the MAP equalizer (whose trajectory is not shown to avoid cluttering). Never- 
theless, the proposed BiDFE method offers a reasonable tradeoff among complexity, performance, and 
latency. 

Finally, Fig. [13] shows the SNR comparison at the output of the unbiased DEE and BiDFE assuming 
ideal feedback on the channel hi when the a priori information is not available. As the figure shows, 
the output SNR of BiDFE is considerably higher than the output SNR of DEE but with a certain gap to 
the matched filter bound (MFB). 

VII. Conclusion 

In this paper, we proposed new SISO DEE and BiDFE structures well-suited to turbo equalization. 
The proposed LLR generation designed to reduce error propagation indeed provides decision-error-free 
performance in the DEE in turbo equalizer setting. When further employing an LLR combining method 
that estimates the correlation between the forward and backward DEE outputs and whitens them, the 
resulting performance is remarkably good given the simple structure of the BiDFE, relative to that of 
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the BCJR equalizer. The proposed LLR generation and combining methods remain effective even when 
a time-invariance constraint is imposed on the feedforward and feedback filters of the DFEs. Overall, the 
proposed BiDFE method based on time-invariant filter taps provides the excellent performance-complexity 
tradeoff for severe ISI channels where the linear SISO equalizer fails to operate adequately. 
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Fig. 1: Bidirectional Decision Feedback Equalizer: Infinite Length. 
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Fig. 2: Iterative Equalization Scheme based on BiDFE. 
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Fig. 4: BER Curve on the Channel hi after 20 Iterations with Time-varying Filters. 
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Fig. 5: BER Curve on the Channel hi after 20 iterations with Time-invariant Filters. 
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Fig. 6: BER Curve on the Channel h2 after 20 Iterations with Time-varying Filters. 
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Fig. 7: BER Curve on the Channel h2 after 20 iterations with Time-invariant Filters. 
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Fig. 8: Noise Correlation of "Proposed BiDFE" on the Channel hi. 
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Fig. 9: EXIT Chart on the Channel hi at a 6 dB with Time-varying Filters. 
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Fig. 10: EXIT Chart on the Channel hi at a 6 dB with Time-invariant Filters. 
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Fig. 11: EXIT Chart on the Channel at a 10 dB with Time-varying Filters. 
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Fig. 12: EXIT Chart on the Channel h2 at a 10 dB with Time-invariant Filters. 
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